Skip to main content

Focused Crawls

Internet Archive

Focused crawls are collections of frequently-updated webcrawl data from narrow (as opposed to broad or wide) web crawls, often focused on a single domain or subdomain.



rss RSS

705,258
RESULTS


Show sorted alphabetically

Show sorted alphabetically

SHOW DETAILS
up-solid down-solid
eye
Title
Date Archived
Creator
Top Domains
collection
351,614
ITEMS
3.9B
VIEWS
collection

eye 3.9B

A daily collection of thousands of the most popular web sites according to Alexa.com's top sites rankings .
Topics: daily, popular sites, Alexa
Top News
collection
248,846
ITEMS
1.7B
VIEWS
collection

eye 1.7B

A daily collection of hundreds of the world's top news sites.
Topics: daily, news
top_domains-00300
top_domains-00300
collection
9,437
ITEMS
114.3M
VIEWS
by Internet Archive
collection

eye 114.3M

top_domains-00500
top_domains-00500
collection
18,584
ITEMS
125.3M
VIEWS
by Internet Archive
collection

eye 125.3M

top_domains-00900
top_domains-00900
collection
5,487
ITEMS
112.1M
VIEWS
by Internet Archive
collection

eye 112.1M

top_domains-00800
top_domains-00800
collection
14,941
ITEMS
86.1M
VIEWS
by Internet Archive
collection

eye 86.1M

top_domains-00350
top_domains-00350
collection
3,343
ITEMS
84.3M
VIEWS
by Internet Archive
collection

eye 84.3M

nytimes.com
nytimes.com
collection
2,947
ITEMS
62.8M
VIEWS
by http://nytimes.com
collection

eye 62.8M

edgi monitor
edgi monitor
collection
20,180
ITEMS
56.9M
VIEWS
collection

eye 56.9M

top_domains-00600
top_domains-00600
collection
10,354
ITEMS
105.7M
VIEWS
by Internet Archive
collection

eye 105.7M

top_domains-00400
top_domains-00400
collection
4,267
ITEMS
69.2M
VIEWS
by Internet Archive
collection

eye 69.2M

top_domains-02500
top_domains-02500
collection
5,404
ITEMS
74.6M
VIEWS
by Internet Archive
collection

eye 74.6M

top_domains-00250
top_domains-00250
collection
2,652
ITEMS
85.9M
VIEWS
by Internet Archive
collection

eye 85.9M

buzzfeed.com
buzzfeed.com
collection
4,123
ITEMS
49.7M
VIEWS
by buzzfeed.com
collection

eye 49.7M

top_domains-01500
top_domains-01500
collection
4,139
ITEMS
80.5M
VIEWS
by Internet Archive
collection

eye 80.5M

nbcnews.com
nbcnews.com
collection
1,832
ITEMS
56.4M
VIEWS
by nbcnews.com
collection

eye 56.4M

top_domains-02000
top_domains-02000
collection
5,061
ITEMS
62.6M
VIEWS
by Internet Archive
collection

eye 62.6M

yahoo.com
yahoo.com
collection
2,890
ITEMS
68.2M
VIEWS
collection

eye 68.2M

top_domains-00450
top_domains-00450
collection
3,864
ITEMS
67.7M
VIEWS
by Internet Archive
collection

eye 67.7M

top_domains-06000
top_domains-06000
collection
4,847
ITEMS
47.4M
VIEWS
by Internet Archive
collection

eye 47.4M

top_domains-00700
top_domains-00700
collection
1,974
ITEMS
69M
VIEWS
by Internet Archive
collection

eye 69M

top_domains-03500
top_domains-03500
collection
2,598
ITEMS
47M
VIEWS
by Internet Archive
collection

eye 47M

foxnews.com
foxnews.com
collection
2,205
ITEMS
42.7M
VIEWS
by http://foxnews.com
collection

eye 42.7M

top_domains-02750
top_domains-02750
collection
3,199
ITEMS
63.3M
VIEWS
by Internet Archive
collection

eye 63.3M

top_domains-07500
top_domains-07500
collection
3,504
ITEMS
61.7M
VIEWS
by Internet Archive
collection

eye 61.7M

top_domains-03000
top_domains-03000
collection
2,820
ITEMS
50.5M
VIEWS
by Internet Archive
collection

eye 50.5M

welt.de
welt.de
collection
3,453
ITEMS
38.3M
VIEWS
by http://welt.de/
collection

eye 38.3M

top_domains-08000
top_domains-08000
collection
2,433
ITEMS
49.7M
VIEWS
by Internet Archive
collection

eye 49.7M

top_domains-04500
top_domains-04500
collection
3,560
ITEMS
49.7M
VIEWS
by Internet Archive
collection

eye 49.7M

top_domains-02250
top_domains-02250
collection
3,420
ITEMS
58.2M
VIEWS
by Internet Archive
collection

eye 58.2M

msnbc.msn.com
msnbc.msn.com
collection
15,758
ITEMS
34.7M
VIEWS
by http://msnbc.msn.com/
collection

eye 34.7M

top_domains-09500
top_domains-09500
collection
4,891
ITEMS
51.7M
VIEWS
by Internet Archive
collection

eye 51.7M

top_domains-04250
top_domains-04250
collection
3,236
ITEMS
47.2M
VIEWS
by Internet Archive
collection

eye 47.2M

top_domains-09000
top_domains-09000
collection
3,877
ITEMS
44M
VIEWS
by Internet Archive
collection

eye 44M

top_domains-04000
top_domains-04000
collection
3,601
ITEMS
48.9M
VIEWS
by Internet Archive
collection

eye 48.9M

taringa.net
taringa.net
collection
1,406
ITEMS
45.9M
VIEWS
by taringa.net
collection

eye 45.9M

top_domains-01250
top_domains-01250
collection
2,182
ITEMS
37.7M
VIEWS
by Internet Archive
collection

eye 37.7M

top_domains-03750
top_domains-03750
collection
2,558
ITEMS
40.8M
VIEWS
by Internet Archive
collection

eye 40.8M

top_domains-01000
top_domains-01000
collection
5,363
ITEMS
51.3M
VIEWS
by Internet Archive
collection

eye 51.3M

time.com
time.com
collection
894
ITEMS
45M
VIEWS
by http://time.com
collection

eye 45M

top_domains-08750
top_domains-08750
collection
3,526
ITEMS
46.4M
VIEWS
by Internet Archive
collection

eye 46.4M

top_domains-04750
top_domains-04750
collection
3,237
ITEMS
41.5M
VIEWS
by Internet Archive
collection

eye 41.5M

top_domains-05250
top_domains-05250
collection
6,013
ITEMS
40.2M
VIEWS
by Internet Archive
collection

eye 40.2M

top_domains-05500
top_domains-05500
collection
8,528
ITEMS
39.9M
VIEWS
by Internet Archive
collection

eye 39.9M

worldpress.org
worldpress.org
collection
674
ITEMS
57.2M
VIEWS
by http://worldpress.org/
collection

eye 57.2M

abcnews.go.com
abcnews.go.com
collection
2,803
ITEMS
28.1M
VIEWS
by http://abcnews.go.com/
collection

eye 28.1M

top_domains-03250
top_domains-03250
collection
1,833
ITEMS
38.8M
VIEWS
by Internet Archive
collection

eye 38.8M

theweek.com
theweek.com
collection
1,892
ITEMS
18.4M
VIEWS
by http://theweek.com
collection

eye 18.4M

top_domains-05750
top_domains-05750
collection
1,919
ITEMS
34.3M
VIEWS
by Internet Archive
collection

eye 34.3M

blogspot.in
blogspot.in
collection
1,411
ITEMS
27.5M
VIEWS
by blogspot.in
collection

eye 27.5M

top_domains-01750
top_domains-01750
collection
1,710
ITEMS
41.3M
VIEWS
by Internet Archive
collection

eye 41.3M

top_domains-08250
top_domains-08250
collection
4,115
ITEMS
36.5M
VIEWS
by Internet Archive
collection

eye 36.5M

top_domains-06250
top_domains-06250
collection
2,511
ITEMS
39.6M
VIEWS
by Internet Archive
collection

eye 39.6M

top_domains-06500
top_domains-06500
collection
3,071
ITEMS
36.1M
VIEWS
by Internet Archive
collection

eye 36.1M

top_domains-06750
top_domains-06750
collection
3,635
ITEMS
39.7M
VIEWS
by Internet Archive
collection

eye 39.7M

sfgate.com
sfgate.com
collection
3,634
ITEMS
32.9M
VIEWS
by http://sfgate.com
collection

eye 32.9M

weather.com
weather.com
collection
1,329
ITEMS
23.4M
VIEWS
by http://weather.com/
collection

eye 23.4M

latimes.com
latimes.com
collection
1,063
ITEMS
31M
VIEWS
by http://latimes.com
collection

eye 31M

bild.de
bild.de
collection
7,481
ITEMS
18.1M
VIEWS
by http://bild.de/
collection

eye 18.1M

top_domains-07250
top_domains-07250
collection
2,648
ITEMS
28.4M
VIEWS
by Internet Archive
collection

eye 28.4M

huffingtonpost.com
huffingtonpost.com
collection
12,583
ITEMS
37.8M
VIEWS
by http://huffingtonpost.com
collection

eye 37.8M

reuters.com
reuters.com
collection
1,140
ITEMS
21.3M
VIEWS
by http://reuters.com
collection

eye 21.3M

top_domains-05000
top_domains-05000
collection
1,489
ITEMS
30.2M
VIEWS
by Internet Archive
collection

eye 30.2M

top_domains-07750
top_domains-07750
collection
1,715
ITEMS
45.8M
VIEWS
by Internet Archive
collection

eye 45.8M

top_domains-08500
top_domains-08500
collection
1,616
ITEMS
28.6M
VIEWS
by Internet Archive
collection

eye 28.6M

abc.net.au-news
abc.net.au-news
collection
2,018
ITEMS
15.3M
VIEWS
by http://abc.net.au/news/
collection

eye 15.3M

chicagotribune.com
chicagotribune.com
collection
633
ITEMS
27.1M
VIEWS
by http://chicagotribune.com/
collection

eye 27.1M

top_domains-07000
top_domains-07000
collection
2,678
ITEMS
35.5M
VIEWS
by Internet Archive
collection

eye 35.5M

themeforest.net
themeforest.net
collection
744
ITEMS
42.1M
VIEWS
by themeforest.net
collection

eye 42.1M

bbc.co.uk
bbc.co.uk
collection
1,102
ITEMS
23.4M
VIEWS
by http://bbc.co.uk
collection

eye 23.4M

edition.cnn.com
edition.cnn.com
collection
1,185
ITEMS
19.6M
VIEWS
by http://edition.cnn.com/
collection

eye 19.6M

fbdailycrawl.io
fbdailycrawl.io
collection
10,227
ITEMS
13.1M
VIEWS
by Internet Archive
collection

eye 13.1M

cnn.com
cnn.com
collection
1,512
ITEMS
22.4M
VIEWS
by http://cnn.com
collection

eye 22.4M

top_domains-09750
top_domains-09750
collection
1,882
ITEMS
25.4M
VIEWS
by Internet Archive
collection

eye 25.4M

inn.co.il
inn.co.il
collection
3,307
ITEMS
28.3M
VIEWS
by http://inn.co.il/
collection

eye 28.3M